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EVALUATION 


This  report  describes  further  results  of  an  approach  to  texture 
discrimination  based  on  spatial  gray-level  co-occurrences  and  maximum 
likelihood  classification.  Previous  results  demonstrated  the  capability 
of  the  log-likelihood  texture  discriminator  to  distinguish  between 
random  texture  areas  where  other  existing  schemes  could  not.  This 
procedure  had  the  requirement  that  the  model  parameters  for  each  of  the 
texture  classes  be  known  a  priori  and  were  substituted  into  the  discrim¬ 
ination  process.  A  method  has  been  developed  for  estimating  the  unknown 
parameters  of  the  texture  models  through  the  incorporation  of  selecting 
representative  training  sets.  This  effort  has  created  a  technique 
that  indicates  an  effective  method  for  performing  texture  discrimination 
on  real-world  imagery.  This  work  has  provided  a  promising  contribution 
to  accomplishing  the  goals  of  technical  planning  objective  R2B2A, 

Digital  Image  Exploitation. 
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After  describing  the  overall  discrim: nation  system  in  Section  II, 
a  thorough  description  of  the  maximum  likelihood  parameter  estimator 
is  given  in  Section  III.  Results  of  the  new  parameter  estimation  tech¬ 
nique  are  given  in  Section  IV,  while  the  efficacy  of  the  log-likelihood 
discriminator  which  makes  use  of  the  parameter  estimates  is  given  in 
Section  V.  Section  VI  provides  a  summary  and  conclusion. 

II .  Log-Likelihood  Discriminator ; 

The  clock  diagram  which  describes  the  log-likelihood  texture  dis¬ 
crimination  system  is  presented  in  rig-  1.  All  input  image  data  which  is  to 
processed  by  either  the  texture  discriminator  or  parameter  estimation 
stage  is  first  passed  through  a  pre-processing  stage.  The  pre-process¬ 
ing  stage  serves  two  purposes.  First,  it  provides  a  degree  of  normalisa¬ 
tion  which  eliminates  -undesirable  effects  such  as  differences  in  illum¬ 
ination,  differences  in  digitization,  etc.  Secondly,  it  serves  to  re¬ 
quantize  the  data  ir.  a  known  fashion.  It  can  be  seen  from  [l]  and  the 
next  section  that  both  the  discriminator  and  parameter  estimator  require 
knowledge  of  the  scheme  used  in  quantizing  the  data.  This  information 
may  net  he  available  in  real -world  applications.  Even  if  the  quantizing 
scheme  were  known,  it  may  be  necessary  tc  re-quantize  the  iata  in  erder 
tc  make  it  suitable  fer  processing  by  the  discriminator  or  parameter  esti¬ 
mator.  An  example  is  the  number  of  gray  levels.  As  seen  in  [ 1 . ,  the 
size  of  the  spatial  gray-level  co-occurrence  matrix  is  3xQ,  where  1  is 
the  number  of  gray  levels.  Therefore,  computational  complexity  of  both  the 
discriminator  and  estimator  is  proportional  to  the  square  of  the  number 
of  gray  levels.  For  computational  reasons,  it  is  clear  that  Q  should  he 
or.sser.  as  small  as  tcssible.  Cr.  the  other  hand,  a  value  cf  5  chosen  toe 


properties,  it  is  reasonable  to  assume  that  a  simple  discriminator  based 
on  first-order  properties  alone  could  be  used  instead  ’of  the  proposer  log- 
likelihood  discriminator. 

Once  a  decision  has  been  made  to  perform  uistcgran  equalization  cm  the 
input  data,  the  choice  cf  a  Gaussian  output  histogram  is  easily  explained. 
The  stochastic  texture  models  described  in  [l], which  will  be  used  as  the 
underlying  stochastic  moceis  for  the  various  texture  classes,  all  possess  *1 
order  Gaussian  statistics.  Thus,  forcing  the  texture  data  tc  possess  a 
Gaussian  histogram  will  at  least  insure  that  there  is  not  a  first-ordei  tis 
match  between  tne  texture  data  and  the  model  which  is  to  be  fitted  by  tne 
parameter  estimator. 

The  above  pre-processing  ssteOe  --  certainly  not  tne  or-lj  on-  .mm 
could  be  used.  If  the  input  data  is  properly  quantized,  then  there  may 
be  no  need  to  perform  any  processing  at  all.  In  fact,  for  the  experiments 
involving  synthetic  textures,  no  pre-processing  was  done  other  than  simple 
binary  scaling  of  the  input  data  from  256  to  6**  gray  levels. 

After  the  original  data  is  processed  by  the  Gaussian  equalization 
stage,  it  is  divided  into  two  groups.  The  first  group  consists  of  the 
training  set,  which  consists  of  images  containing  only  one  texture  whose 
class  is  known.  This  data  is  passed  to  the  parameter  estimator  which  lo exs 
individually  at  the  texture  data  for  each  known  class  and  attempts  tc 
fit  the  assumed  ‘underlying  stochastic  image  model  to  each  class.  The 
unknown  structural  parameters  are  estimated  for  each  class  and  used  by 
the  discriminator  to  form  the  log-likelihood  functionals  for  each  texture 
class  as  described  in  [lj.  The  second  group  of  data  consist  cf  the  un¬ 
known  set;  those  images  which  are  known  to  contain  several  textures 
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vhose  classes  are  unknown.  This  group  of  images  is  passed  to  the  dis¬ 
criminator  and  processed  as  described  in  [ 1 ] . 


As  can  be  seen,  the  discrimination  system  described  here  differs 
from  that  in  [l]  in  that  a  training  set  must  be  available  which  contains 
known  texture  data  from  each  of  the  possible  classes,  and  a  parameter 
estimator  uses  the  training  set  to  estimate  'unknown  structural  parameters 
for  each  texture  class  which  were  assumed  known  in  the  preliminary  experi 
ments  conducted  in  [l].  Also,  for  real-world  data,  the  pre-processing 
described  above  is  used  to  normalize  the  data. 

III.  Parameter  Estimation  Technique: 

In  this  section  a  description  of  the  techniques  used  to  develop  appr 
imate  maximum  likelihood  estimates  of  the  -unknown  structural  parameters 
is  presented.  It  will  be  seen  that  development  of  the  proposed  estimator 
parallels  almost  exactly  the  development  of  the  discriminator  described 
in  [Ij. 

Recall  from  [l]  that  {f.  }K  is  the  input  image  and  H  ,  k=C,l, 

i,j=l 

. . . ,K-1  represent  the  K  possible  texture  classes  or  hypotheses. 

Also,  recall  that  F.  A  represents  the  observations  contained  in  a  window 
of  size  ( 2M+1 )x(2M+l)  centered  about  pixel  position  (i,j'.  That  is, 


F  =  -f 


,  i-M<k<i+M,  j -M<£ <j  +M }  i  ,  j=l  ,2 , .  . .  ,j» 


where  N  is  the  total  number  of  pixels  along  each  side  of  the  assumed  squa 

image  array.  From  the  data  contained  in  this  window  the  gray-level  co-occ 

matrix  was  calculated  for  a  fixed  distance  d  for  all  rotation  angles  and 

called  P.  ,(d).  The  log-likelihood  classifier  assigned  the  tixel  (i,^) 

1 

to  the  class  k(i,j)=k  if 

0 


at* 


am 


(2) 


where 


L  {P.  .(d)}  =  max  L.  (P.  .(d)} 

0  0<k<K-l  * 

p{P  (d)|H  } 

VPil3(d))-*n  p ~(d)}  k=0,l,...,K-l  . 


(3) 


■ol  i,j 

represents  the  class-conditional  log-likelihood  functional. 

Now,  instead  of  maximizing  over  the  possible  texture  classes,  it  is 

proposed  that  the  appropriate  log-likelihod  functionals  be  maximized  over 

the  range  of  unknown  model  values  to  determine  approximaxe  maximum 

likelihood  estimates  of  unknown  structural  parameters.  More  precisely, 

N 

let  {f.  }  now  represent  image  data  from  the  training  set  which  is  knovr 

i ,  j=l 

to  contain  homogeneous  texture  data  from  only  one  class  H  .  Assume  that 
a  suitable  stochastic  image  model  has  been  chosen  and  let  a  represnet 
the  vector  containing  the  model  parameters  which  are  unknown  and  have  to 
be  estimated  from  the  gray-level  co-occurrence  matrix  calculated  from  the 
data.  Since  the  entire  image  is  known  to  contain  only  one  texture,  the 
co-occurrence  matrix  can  be  calculated  over  the  entire  image  and  denoted 
P( d).  Also,  let  A  represent  the  set  of  possible  values  which  the  unknown 
parameter  vector  a  may  attain.  The  log-likelihood  functional  conditioned 
or.  H  and  parameter  vector  a  is  then 

p(P(d) |H  ,  a} 


L^{  P  (d)  ;a>  =  Jin 


i  — 


pQ{P(d) } 


(h) 


The  approximate  maximum  likelihood  estimate  of  the  unknown  parameter  vector 
is  the  value  which  maximizes  the  log-likelihood  functional  of  (1*).  That 
is,  the  maximum- likelihood  estimator  a^  satisfies 

L.{P(d);a  }  =  max  L.{P(d);a; 

A  AL)  t  &  * 

acA 


(5) 


By  comparing  Eqs.  (U)  and  (5)  with  Eqs.  (l),  (2),  and  (3),  it  can 
be  seen  that  the  proposed  parameter  estimation  scheme  follows  the  same 
logic  and  uses  many  of  the  elements  of  the  previously  proposed  discrim¬ 
ination  scheme.  It  is  now  necessary  to  specify  a  practical  way  of  solv¬ 
ing  equation  (5).  The  most  common  method  is  to  take  fi’-st  derivatives 
and  set  the  resulting  equation  to  zero.  That  is,  solve 


syPU) 

3a 


(6) 


However,  for  the  stochastic  models  which  are  of  interest  no  closed  form 
solution  to  (6)  has  yet  been  found.  Therefore,  it  has  been  necessary  to 
resort  to  a  more  direct  but  somewhat  computational  solution  to  equation 
( 5 ) .  This  involves  performing  a  computer  search  over  the  permissible 
parameter  space  A  and  taking  the  value  a,^  which  maximizes  (5). 

Since  for  a  continuous  parameter  space,  the  range  of  possible  values  is 
■uncountable,  it  is  necessary  to  lay  a  discrete  grid  of  points  over  the 
parameter  space  and  evaluate  the  log-likelihood  functional  only  at  those 
points.  Clearly,  there  is  a  tradeoff  involved  in  specifying  this  grid. 
If  the  grid  points  are  spaced  toe  far  apart,  the  calculated  maximum  may 


be  far  from  the  true  maximum,  resulting  in  poor  parameter  estimates.  It. 
the  other  hand,  spacing  the  grid  points  too  close  together  will  result 
in  an  unnecessary  computational  burden. 

It  should  be  noted  that  more  sophisticated  search  techniques  than 
the  one  described  above  could  be  used  to  reduce  the  computational  burden, 

their  increased  programming  complexity. 


but  were  not  used  due  to 


At  this  point  it  is  necessary  to  specify  the  underlying  stochastic 
model  to  be  used  in  the  experiments  described  in  the  following  experiments. 


The  model  chosen  is  the  rectangular  partition  process  described  in  [ 1 ] . 
From  [l],  it  can  be  seen  that 


Q-l  Q-l 

Ii,{P(d);a}  -  l  I  p(m,n;d)  a  (m,n;d,ji) 
m=0  n=0  * 


where 


J-k(m,n;d,a)  =  In  nU;Hk>a)  . 


Recall  that  Q  (d;H,  ,a)  is  the  probability  of  observing  gray-levels 

IS  ^  II  K 

m  and  n  at  a  particular  pair  of  points  separated  by  a  distance  d  condition¬ 
ed  on  texture  class  H  and  parameter  vector  a.  Also,  recall  from  [l] 


.  ,  .  .  I  m+'l  “n+1  .  , 

L  L 

m  a 


where  E  ,  1=0,1, ... ,Q-1  represent  the  quantization  levels  and  LL 

the  spatial  sampling  interval. 

For  the  rectangular  partition  process,  the  second-order  p.d.f. 

P-,{  ,f2;a,diL}in  (9)  can  be  evaluated'  from  corresponding  results  in  [ 1 ] . 


where 


=  J±Q  hji(fi’f2)p£(  i  ia!  i ) 

I  J  1 

■‘i*  2 - 77=rr  exp - : - —  >i  i>o 

2Tra2/l -p22  )  2c2(l-p2jl)  [ 


exp  < - >6(f1-f2)  •,  1=0 


For  r.otational  convenience  we  have  suppressed  the  conditioning  on  H, 
ar.d  a_  in  ( 10 )  although  this  conditioning  is  clearly  implicit. 
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vas  0.025.  The  grid  region  was  chosen  to  encompass  the  actual  parameter 
values  for  all  the  realizations  so  that  the  maximum  values  would  be  ex¬ 
pected  to  fall  within  the  search  regions  and  not  on  a  boundary.  A  compar¬ 
ison  of  the  actual  and  estimated  parameter  values  for  each  realization 
for  various  distances  is  presented  in  Table  1.  It  can  be  seen  that  the 
parameter  estimates  are  quite  good  in  all  cases.  Due  to  the  grid  spac- 
ings ,  it  is  difficult  to  determine  which  values  of  d  provides  the  best 
result.  The  question  of  which  value  of  d  is  best  in  general  application  of 
the  parameter  estimator  and  discriminator  will  be  presented  in  Section  VI. 

It  is  of  some  interest  to  see  how  the  value  of  the  log-likelihood 
functional  cf  (7)  varies  over  the  search  grid.  Three-dimensional  plots 
cf  the  resulting  likelihood  surfaces  for  the  cases  considered  are  illustrated 
in  Fig.'s  h— 12 -  The  labeled  axes  represent  the  values  of  o  and  X  over  which  the 
search  was  performed  while  the  remaining  axis  represents  the  value  of 
the  iog-likelihooc  functional  for  the  corresponding  values  cf  p  and  A. 

It  can  be  seen  that  the  surfaces  are  generally  quite  smooth  with  no 
sharp  peaks  at  the  maximum. 

After  demonstrating  tret  the  estimator  works  for  the  synthetic  image,  it  now 
is  cf  interest  to  apply  the  parameter  estimator  to  real-world  imagery 
as  a  first  step  in  a  total  texture  discrimination  approach.  The  test 
images  used  consist  of  selected  samples  of  Brodatz  textures  [4}.  Typical 
samples  of  grass,  raffia,  and  herringbone  are  illustrated  in  Fig.  13- 
These  images  consist  of  256x256  pixels  and  have  been  processed  by  the  Gauss¬ 
ian  equalization  stage  described  in  Section  II  to  possess  6k  gray-levels,  a 
mean  of  32,  and  a  variance  of  156.25-  The  parameter  estimation  scheme  was 
actually  applied  to  three  such  samples  of  texture  to  give  the  parameter 


estimates  presented  in  Table  2.  For  each  of  the  estimates,  the  search 
region  was  chosen  empirically  so  that  the  maximum  occurred  in  the  inter¬ 
ior  of  the  region.  For  the  case  d=l  all  of  the  X  estimates  are  greater 
than  unity,  and  as  d  gets  larger,  the  estimated  values  of  X  decrease. 

The  high  values  of  estimated  edge  density  and  the  fact  that  these  esti¬ 
mates  vary  greatly  for  different  values  of  d  is  somewhat  discomforting. 

If  the  assumed  rectangular  partition  process  provided  an  accurate  model 
for  the  Brodatz  textures,  values  of  X  less  than  unity  which  remain  relatively 
constant  for  different  values  of  d  would  be  expected.  That  this  does  net 
occur  can  be  explained  by  comparing  the  properties  of  the  rectangular 
partition  process  to  the  properties  of  real-world  textures.  Realiza¬ 
tions  of  the  rectangular  partition  process  are  composed  of  regions  of  constant 
gray  level  while  most  real-world  textures  are  composed  of  regions  of 
nearly  constant  gray  level.  As  mentioned  in  [l],  the  above  properties 
of  the  rectangular  process  results  in  a  large  discrete  probability  mass 
along  the  main  diagonal  of  the  grav-level  co-occurrence  matrix  while  fer  real- 
world  textures  this  probability  mass  will  be  distributed  over  the  diagon¬ 
als  close  to  the  main  diagonal.  The  high  values  of  estimated  edge  density 
which  result  and  the  fact  that  they  decrease  as  d  gets  larger  are  direct 
result  of  this  mismatch  between  the  model  and  actual  data.  Enhancements 
to  the  rectangular  process  model,  such  as  the  addition  of  a  white  noise 


field,  might  eliminate  this  problem.  In  the  meantime,  however,  some  consolation 
can  be  taken  from  the  fact  that  the  estimated  parameter  values  for  the 
three  textures  are  significantly  different,  which  leads  to  the  hope  that 
even  though  the  modeling  assumptions  are  somewhat  inaccurate,  overall  discrim¬ 


inator  performance  should  still  be 
the  next  section. 


goon. 


V.  Discriminator  Results: 


Making  use  of  the  parameter  estimates  described  in  the  previous  sec¬ 
tion,  severed  discrimination  experiments  vere  performed.  The  2-D  digital 
filtering  implementation  approach  described  in  [l]  vas  used  as  was  the 
Wiener  filtering  approach  to  filter  design.  The  specifications  and 
resulting  parameters  for  the  designed  filters  are  provided  in  Table  3. 

Note  the  coefficient  A  described  in  [l]  is  not  included  since  it  is  an 
overall  gain  factor,  and  vas  taken  equal  to  unity,  vhich  will  not  affect 
the  results.  Comparison  of  the  desired  and  actual  frequency  responses  for 
the  designed  filters  is  provided  in  Fig.'s  lU-l6. 

The  first  experiment  performed  involved  processing  the  same  synthet¬ 
ic  test  image  as  used  in  [l].  Recall  this  test  image  is  composed  of  three 
distinct  realizations  of  the  rectangular  process  possessing  different 
parameters,  as  shown  in  Fig.'s  17-19- 

Since  the  parameter  estimates  are  quite  close  to  the  actual  values, 
and  the  filters  used  are  the  same  as  those  used  in  [l],  it  is  not  surprising 
that  the  results,  shown  in  Figs.  17-19»  are  similar  to  those  in  [l].  The  case  d=l 
appears  to  provide  the  best  results,  particularly  for  the  weak  and  moder¬ 
ate  filtering  cases.  This  result  tends  to  disagree  with  the  statement 
in  [l]  that  a  distance  equal  to  the  reciprocal  of  the  average  edge  density 
of  the  textures  being  processed  is  the  optimum  distance  for  texture  dis¬ 
crimination.  More  will  be  said  about  about  this  question  later. 

To  test  the  discriminator  on  real-world  data,  the  original  test  image 
in  Fig. 20a  vas  created  which  contains  samples  of  the  three  Brodatz  texture 
used  in  Section  III.  The  upper-left  or  NW  side  of  the  image  contains  raffia 
texture  data,  the  right  or  I  side  of  the  image  contains  grass,  and  the 
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bottom  or  S  portion  of  the  image  consists  of  herringbone. 


The  results  of  the  discriminator  using  the  parameter  estimates  of 
Table  2  and  the  filters  specified  in  Table  3  are  presented  in  Fig.'s 
20-22-  As  was  the  case  for  the  synthetic  test  image,  a  distance  of 
d=i  produced  the  best  results.  For  this  distance,  the  strong  filter 
provides  excellent  results  comparable  to  the  synthetic  test  case,  while 
the  results  fcr  the  wear,  and  moderate  filters  are  clearly  inferior.  This 
tends  to  indicate  that  for  the  real-world  test  case,  more  smoothing  is 
required  by  the  filter  to  remove  incorrectly  discriminated  areas  caused 
by  irregular  areas  in  each  texture. 

VI .  Summary  and  Conclusions 

A  method  fcr  estimating  the  structural  parameters  of  a  specif -c  sto¬ 
chastic  texture  model  has  beer,  proposed  fcr  use  with  the  text-ore  discrim¬ 
ination  scheme  described  in  [l^.  This  parameter  estimation  scheme  has 
been. shown  to  provide  good  results  when  used  or.  realisations  of  the  rec¬ 
tangular  partition  process  for  various  choices  of  model  parameters.  When 
applied  to  selected  samples  of  the  Brodatz  [-]  textures,  the  parameter 
estimation  scheme  gives  values  which  indicate  that  the  rectangular  part¬ 
ition  process  is  not  an  ideal  model  for  real-wcrld  textures,  however, 
results  of  using  the  texture  discriminator  or.  samples  containing  Brodati 
textures  are  quite  good,  indicating  that  the  proposed  texture  discrimin¬ 
ation  technique  can  be  effective  on  real-wcrld  texture.  Several  extension 
to  the  procedure  are  suggested  which  might  improve  performance. 

For  example,  results  indicate  that  the  rectangular  partition  process 
is  not  an  ideal  model  for  real-wcrld  textures  because  it  possesses  regions 


of  constant  gray  level  while  real  world  textures  usually  possess  regions 
of  nearly  constant  gray  level.  A  logical  step  would  be  to  consider  add¬ 
ing  a  white  noise  component  to  the  rectangular  partition  process,  and 
redevelop  the  expressions  for  second-order  p.d.f.'s  which  are 
used  in  the  discriminator  and  parameter  estimator. 

Another  possible  solution  to  this  modeling  mismatch  might  be  to  in¬ 
clude  in  the  pre-processing  stage  a  step  which  isolates  regions  of  nearly 
constant  gray  level  and  alters  the  intensity  of  each  pixel  within  each 
region  to  a  suitable  constant  gray  level.  Hopefully,  this  step  would 
allow  the  processed  images  to  retain  their  textural  properties  while 
providing  for  a  closer  match  between  texture  and  model,  resulting  in 
improved  discrimination  results. 

One  modification  to  the  texture  discrimination  system  which  is  proposed 
is  the  elimination  of  the  Wiener  filtering  approach  to  the  2-D  digital 
filtering  implementation.  It  seems  obvious  from  looking  at  the  frequen¬ 
cy  responses  that  the  Wiener  filters  can  be  replaced  by  simple  lowpass 
filters  parametized  by  cutcff  frequency.  Although  this  change  would 
net  reduce  discriminator  computational  complexity,  it  would  simplify 
filter  design  and  make  it  easier  to  relate  discriminator  performance 
tc  the  choice  of  filter  parameters. 

One  of  the  questions  which  must  be  answered  is  which  value  of  dis¬ 
tance  i  between  pixels  is  the  best  to  use  in  the  proposed  texture  discrim¬ 
inator  and  parameter  estimator.  Since  the  desired  objective  is  to  maxi¬ 
mize  discriminator  performance,  it  seems  obvious  that  the  best  distance 
is  the  value  of  d  which  provides  maxim-urn  separation  of  the  parameter 


estimates  for  each  of  the  texture  classes  being  considered.  The  results 
for  the  Brodatz  test  image  show  this  to  be  true.  Despite  the  fact  that  the 
model  used  provides  an  inaccurate  fit  to  the  textures, the  fact  that  the  para¬ 
meter  estimates  are  significantly  different  for  all  three  texture  class¬ 
es  for  the  case  q=1  results  in  good  discriminator  performance. 

In  any  event .  it  is  believed  that  the  proposed  text -ere  di scrim! n- 
?- .  "t  car.  be  used  to  provide  effective  performance  ir.  a  variety  of  real-vcrld 
*~x — are  discrimination  problems  ".-other  verb  is  being  dcr.e  to  im¬ 
prove  discriminator  performance  and  establish  the  efficacy  of  this 
approach  as  applied  to  .the:  real  ooio  *e>t  re  problems. 
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Selected  Samples  of  Brodatz  Textures 
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d. )  Actual  Response 
for  Filter  5 
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Frequency  Responses  of  Desired  and  Actual  Filters  for  d=2 


b. )  Actual  Response 
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Performance  of  Log- Likelihood  Discriminator 
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MISSION 

of 

Rome  Air  Development  Center 


RA VC  plant  and  executes  research,  development,  test  and 
s elected  acquisition  programs  in  support  of  Command,  Control 
CormunacaMons  and  Intelligence  ( C 5 7  )  actlviM.es.  Technical 
and  engineering  support  within  areas  o f  technical  competence 
is  provided  to  ESV  Program  Offices  (PCs)  and  other  ESV 
elements.  The  principal  technical  mission  areas  are 
communications,  electromagnetic  guidance  and  control,  sur- 
veillance  of  ground  and  aerospace  objects,  intelligence  data 
collection  and  handling,  information  system  technology, 
ionospheric  propagation,  solid  state  sciences,  microwave 
physics  and  electronic  reliability ,  maintainability  and 
compatibility. 


